Criterion validity of a competency-based assessment center in medical education – a 4-year follow-up study
نویسندگان
چکیده
Introduction Core competencies have progressively gained importance in medical education. In other contexts, especially personnel selection and development, assessment centers (ACs) are used to assess competencies, but there is only a limited number of studies on competency-based ACs in medical education. To the best of our knowledge, the present study provides the first data on the criterion-related validity of a competency-based AC in medical education. Methods We developed an AC tailored to measure core competencies relevant to medical education (social-ethical, communicative, self, and teaching) and tested its validity in n=30 first-year medical students using 3- to 4-year follow-up measures such as (a) objective structured clinical examinations (OSCE) on basic clinical skills (n=26), (b) OSCE on communication skills (n=21), and (c) peer feedback (n=18). The AC contained three elements: interview, group discussion, and role play. Additionally, a self-report questionnaire was provided as a basis for the interview. Results Baseline AC average score and teaching competency correlated moderately with the communication OSCE average score (r=0.41, p=0.03, and r=0.38, p=0.04, respectively). Social-ethical competency in the AC showed a very strong convergent association with the communication OSCE average score (r=0.60, p<0.01). The AC total score also showed a moderate correlation with the overall peer feedback score provided in Year 4 (r=0.38, p=0.06). In addition, communicative competency correlated strongly with the overall peer feedback (r=0.50, p=0.02). We found predominantly low and insignificant correlations between the AC and the OSCE on basic clinical skills (r=-0.33 to 0.30, all p's>0.05). Conclusion The results showed that competency-based ACs can be used at a very early stage of medical training to successfully predict future performance in core competencies.
منابع مشابه
Needs assessment in medical education with emphasis on outcome-based education: Systematic review
Outcome-based education has a key role in the development of medical education and emphasizes on empowering students according to the needs of society. The purpose of this study is to determine the components and implementation methods of educational needs assessment based on outcome. Methods: The present article is a review study through systematic search in valid domestic and foreign scienti...
متن کاملThe Validity and Reliability of the Objective Structured Clinical Examination (OSCE) in Pre-internship Nursing Students
Introduction: Validity and reliability are essential criteria for clinical competency assessment tests. This study was conducted to determine the validity and reliability of the Objective Structured Clinical Examination (OSCE) for nursing pre-internship. Methods: This methodological study was done on 36 pre-internship Nursing students of Golestan University of Medical Sciences in 2...
متن کاملThe Validity and Reliability of the Objective Structured Clinical Examination (OSCE) in Pre-internship Nursing Students
Validity and reliability are essential criteria for clinical competency assessment tests. This study was conducted to determine the validity and reliability of the Objective Structured Clinical Examination (OSCE) for nursing pre-internship. Methods: This methodological study was done on 36 pre-internship Nursing students of Golestan University of Medical Sciences in 2016. Census method was us...
متن کاملCredibility of the Pattern of Educational Qualification of Faculty Members
Background: the success of faculty members of Medical Sciences Universities in medical education arena requires qualification and capabilities authentication in relation with education. In order to achieve these capabilities, it is necessary to use new and influential approaches of empowerment. One of the appropriate approaches is “Competency Based Training” (CBT). In this method, competencies...
متن کاملInterns’ Change Readiness in Terms of Self-assessment of Clinical Competency in Mashhad University of Medical Sciences
Introduction: The ability to perform a self-assessment as a critical competency of professionalism is considered essential for medical students at the Medical Education Accreditation Council. In this study, interns’ status of readiness to change was investigated in terms of self-assessment of clinical competency in Mashhad University of Medical Sciences using construct of the stages of change o...
متن کامل